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We study Langevin dynamics describing nonequilibirum steady states. Employing the phenomeno- 
logical framework of steady state thermodynamics constructed by Oono and Paniconi [Prog. Theor. 
Phys. Suppl. 130, 29 (1998)], we find that the extended form of the second law which they proposed 
holds for transitions between steady states and that the Shannon entropy difference is related to the 
excess heat produced in an infinitely slow operation. A generalized version of the Jarzynski work 
relation plays an important role in our theory. 
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The second law of thermodynamics describes the fun- 
damental limitation on possible transitions between equi- 
librium states. In addition, it leads to the definition of 
entropy, in terms of which the heat capacity and equa- 
tions of state can be treated in a unified way. 

In contrast to equilibrium systems, with their elegant 
theoretical framework, the understanding of nonequilib- 
rium steady state systems is still primitive. The broad 
goal with which we are concerned in this paper is to 
establish the connection between the phenomena dis- 
played by nonequilibrium steady states and thermody- 
namic laws. We expect that a unified framework that 
describes both equilibrium and nonequilibrium phenom- 
ena can be obtained by extending the second law to the 
state space consisting of equilibrium and nonequilibrium 
steady states. There have been several attempts to con- 
struct such a framework jj], [|, ||, [|. Among them, a phe- 
nomenological framework proposed by Oono and Pani- 
coni seems most sophistcated, and their framework has 
been named 'steady state thermodynamics' (SST) Q). 

Oono and Paniconi focused on transitions between 
steady states and distinguished steadily generated heat, 
which is generated even when the system remains in a 
single state in the state space, and the total heat. They 
call the former the "house-keeping heat". Subtracting 
the house-keeping heat from the total heat defines the 
excess heat, which reflects the change of the system in 
the state space: 
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Here Qtot and Qhk denote the total heat and the house- 
keeping heat, respectively. By convention, we take the 
sign of heat to be positive when it flows from the system 
to the heat bath. 

For equilibrium systems, Q cx reduces to the total heat 
Qtot, because in this case — 0. Because any proper 
formulation of SST should reduce to equilibrium thermo- 
dynamics in the appropriate limit, Q C x should correspond 
to the change of a generalized entropy S within the SST. 
Here we treat systems in contact with a single heat bath 
whose temperature is denoted by T, so that the second 
law of SST reads B 



The equality here holds for an infinitely slow operation in 
which the system is in a steady state at each time during 
a transition. (We call such a process a "slow process".) 
That is, the generalized entropy difference AS* between 
two steady states can be measured as —Q ex /T resulting 
from a slow process connecting these two states. This 
allows us to define the generalized entropy of nonequi- 
librium steady states, because using it we can deter- 
mine the generalized entropy difference AS* between any 
nonequilibrium steady state and a nearby equilibrium 
state, whose entropy is known. 

These are phenomenological considerations and they 
should ultimately be confirmed through experiments. As 
a preliminary step toward this confirmation, in this Let- 
ter, we find support for the validity of the above discus- 
sion by studying a simple stochastic model. With the 
same motivation, Sekimoto and Oono considered a sim- 
ple Langevin system and defined the quantity Q ex ^ [|. 
However, this nonequilibrium system reduces to an equi- 
librium system through a suitable transformation of vari- 
ables and hence lacks generality. Also, one of the present 
authors has found that the minimum work principle holds 
for certain types of transitions between steady states , 
with some assumption regarding the steady state mea- 
sure. In this Letter, we derive the inequality (||) in a 
more general context and show that the equality holds 
for slow processes. This result relates the excess heat to 
the generalized entropy. 

We consider the dynamics of a Brownian particle in a 
circuit driven by an external force. These dynamics are 
described by the Langevin equation 
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where £(t) represents Gaussian white noise whose inten- 
sity is 2^k^T. We employ periodic boundary conditions, 
and thus the particle flows due to the nonconservative 
force /. This simple nonequilibrium system was inves- 
tigated by Kurchan with regard to the fluctuation theo- 
rem |^| . Transitions between steady states are realized by 
changing the parameters A and /. We assume that if the 
system is left unperturbed, it eventually reaches a steady 
state which is uniquely determined by the parameter val- 
ues. Although we consider an explicitly one-dimensional 



2 



system for simplicity, multi-dimensional cases, including 
many-particle systems, are essentially the same. 

We write the steady state probability distribution func- 
tion as p ss (x;a), where a denotes the set of control pa- 
rameters of the system, A and /. Then we manipulate 
the system by changing the value of a during the inter- 
val from t = to t — t* . We assume that the system 
is initially in a steady state, and after the completion 
of the manipulation it converges to a new steady state. 
Let t denote the time at which the system reaches the 
new steady state (0 < t* < t). We descretize [0,t] as 
[to,ti, ■ ■ ■ ,tjv]< We denote the value of a at the ith time 
step by a*. This value changes at each time step from 
time to until time £m = t* , while after this time it re- 
mains fixed: cti — cum for i > M. We also write x(ti) as 
Xi. We consider the limit of an infinitely fine discretiza- 
tion by keeping r* and r fixed and taking N — > oo. 

Let us introduce a new quantity 4>(x; a) defined by 



(x;a) = - logp ss (x] a) 
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where p ss {x] a) is the probability distribution function of 
the steady state corresponding to a. Let P(x'\x;a) be 
the transition probability from x to x' in one time step 
(whose length is At — t/N) for a given value of a. Note 
that by definition 



dxP(x\x';a)p ES (x';a) = p ss (x;a). 



(5) 



Then for a given sequence (xq, X\, ■ ■ ■ ,%n)i which is col- 
lectively denoted by [x], the average of a quantity g([x]) 
is written as 
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where the symbol ~ expresses that this is an approximate 
equality that becomes exact in an appropriate, infinitely 
fine descretization limit of N — * oo. 

Now, in order to derive Eq. (|J) for the system de- 
scribed by Eq. (|^), we utilize a Jarzynski-type equality. 
For transitions between isothermal equilibrium states, 
it is known that the following equality holds between 
the work done to the system W and the equilibrium 
Helmholtz free energy difference AF [f|: 
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Here (3 = 1 /ksT and (-) c denotes the average over all pos- 
sible histories with respect to equilibrium fluctuations. 
Note that the minimum work principle (W) c > AF im- 
mediately follows from this relation, due to the Jensen 
inequality (e x ) > . In a similar way, we now set out 
to derive Eq. (Q) through the somewhat generalized ver- 
sion of Eq. ([?]) 



(exp[-/3Q ex - A<£]> = 1, 
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where A<f> = 4>(xn] oln) — 4>{xq, ao). 
We start with the identity 
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p ss (x i+ i; a i+ i) 
p 3S {x l+ i,a t ) 



This follows from Eqs. (||) and (??) 
using 4>, we have 



J* 1 (9) 
Rewriting Eq. (||) 
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^ {-<P(xi+i;a i+1 ) + <p(x i+1 ;o!i)} 
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Taking the limit TV — > oo, Eq. ( ^0| ) becomes 

d<fi(x; a) 
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It can be easily seen that Eq. ( |11| ) reduces to the equilib- 
rium Jarzynski equality (^) when we set <fi = —0(F — U). 



Now we express the left-hand side of Eq. (|llj) in terms 
of heat, so that we can find the correspondence with Eq. 
(||). First, for Langevin systems, the total heat flowing 
into the heat bath, Qtot, is defined by 



Qtot = / dt[ix(t)-£(t)\x(t). 
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Note that the products of x{t) and the other quantities 
are of the Stratonovich type. This interpretation of the 
heat was proposed and investigated by Sekimoto p0| . 
In addition, we note that /3Qtot satisfies the fluctuation 
theorem if the system remains in a steady state ^ . 
Next we rewrite Eq. (||) as 



where 
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Equation (|l3|) corresponds to the decomposition of the 
flux x into an irreversible part b(x ) and a reversible part 
86] dx, in the sense of Refs. [pTL O]. Multiplying Eq. 
( |l3| ) by x(t)dt and integrating with respect to t from 
t = to t = t, we get 



PQtot = / dt/3b(x)x(t) -A(f> + 

Jo Jo 
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Here we define the house-keeping heat as [|R 

dtb{x)x(t). 



(15) 



(16) 



Using Q ox = Qtot — Qhk, we can rewrite Eq. ( O ) as the 
generalized Jarzynski equality (H). 
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Now we derive the Second Law for SST. From Eq. (g) 
and the Jensen inequality, we obtain 



/3(Q CX ) + (A<P) > 0. 



(17) 



We assume that r is sufficiently large, so that the cor- 
relation between Xo and xn can be ignored. Then {Acj)) 
reduces to the difference between the averages of 4>(x; a) 
with respect to the initial and the final steady state mea- 
sures. Now, note that with the information-theoretic 
(Shannon) entropy given as 
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dxp ss {x;a) log p ss (x;a), 
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the quantity (A(f>) is equal to AS. Equation ([l?]) then 
becomes 



TAS > -(Qex). 



(19) 



Thus if we identify the Shannon entropy with the gener- 
alized entropy S, we obtain the second law for SST, Eq. 

We next consider a slow process in which the distribu- 
tion function of the system can be regarded as p ss (xi] Oii) 
at each time is. We then have 



da 



d(j)(x; a) 
da 



dadxp ss (x;a) |j20) 
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Recalling that 
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da = A<p- <y ox , 
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we can prove that the equality holds in Eq. ( J19| ) for a 
slow process. 



Equation (17), together with the discussion following 
it, constitutes the main result of this Letter. In the fol- 
lowing we discuss five important points that are periph- 
erally related with this main result. 

First, because we have been able to define a generalized 
entropy, we can also define a generalized Hclmholtz free 
energy F valid for noncquilibrium steady states. 

F(a) = J dxp ss (x;a)U(x;X)-TS(a). (23) 

From the second law for SST, Eq. (|l9|), if we define the 
excess work by 

W cx = Q ox + AU, (24) 
the minimum work principle for SST immediately follows: 

(W ox } — AF > 0. (25) 
The equality here holds for slow processes, as in the case 



ofEq. (19) 



The next point we wish to discuss regards the function 
b(x). The physical meaning of this function as defined 
by Eq. (14) is somewhat unclear. Because this quantity 



also appears in the definition of the house- keeping heat, 
it would be helpful if we could obtain a more intutitivc 
expression for it. We now derive such an expression. We 
consider the local probability current, j ss , for a given 
steady state. 
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-P — 1" [J 5 \p ss (x]a). (26) 
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dx 



This value is independent of x for the one-dimensional 
case. Using Eqs. (0) and dlj), Eq. (26) becomes 



b(x) 



Us 



Pss{x;a) 



(27) 



which is propotional to the local average velocity. 

As the third point of interest, we now discuss the rela- 
tion between the generalized Jarzynski equality and the 
fluctuation theorem || [l4|, [l5| [l6| . Our argument is the 
generalization of the Crooks argument |fl7f , which focuses 
on transitions between equilibrium states. 

We first review the fluctuation theorem, following Ref. 
fL6|| . Let c([a;]) be defined according to 



exp[-T<r([x])] = 
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n 



P(x i+ i\xi]di) 
P(x i+ i\x t ;ai) 



p ss (xo;ao) 
p ss (xo; ao) ' 



where Xi = xn- 
express to as 



(28) 

and a~i = ajy-i- Note that we can 
ro = (3Q tot - A(b (29) 



by using an explicit form of P(xi+i\xi; a,-) |l8[ ]. By a 
straightforward calculation, we find that the probability 
distribution of cr([a;]), which is denoted by n CT (z), satisfies 



Il CT (z) = exp(rz)n (T (-z), 



(30) 



where the function IIo- is the probability distribution of 
<7 ([a;]) for the system with the parameter set a obtained 
from a under time reversal. Equation (p0|) leads to 



(exp(— to)) = 1. 



(31) 



We remark that for the case of time-independent a, Eq. 
(|30| ) reduces to the relation referred to as the fluctuation 
theorem. 

As Crooks demonstrated 17 1, Eq. ( ^T|) yields the 
Jarzynski equality (|7|) if we are concerned with transi- 
tions between equilibrium states. However, for transi- 
tions between nonequilibrium steady states, Eqs. ( |29| ) 
and ( |3l| ) with the Jensen inequality do not provide our 
result Eq. (|), but rather TAS > -(Q to t)- Although 
this inequality does hold, the equality cannot be real- 
ized since — (Qtot) is negative infinite for slow processes. 
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Thus we cannot define the generalized entropy through 
Eq. ©. 

In order to clarify the difference between Eq. (ph and 
Eq. (fl|), we rewrite Eq. (|) as 



p ss (x N ;a N ) 
p ss (xi\a ) 



7V-1 



n 



(xi\x i+ i; cti) 



L P(x i+ i\Xi\Oti) 



= 1, 



(32) 



where P^ (xi\xi+i; eti) is the dual transition probability 
HI defined by 

P\x l \x l+ i]a i )p ss {x i+1 ;a l ) = P(x i+1 \xi;ai)p ss (Xi;ai). 

(33) 

When the detailed balance condition is satisfied, Eq. (|3^ ) 
together with Eq. (|2|) leads to Eq. @, due to the 
equality P^ = P. However, the detailed balance condi- 
tion is violated in nonequilibrium steady states, and thus 
the generalized Jarzynski equality is not directly related 
to the fluctuation theorem. 

The above discussion leads us to the fourth important 
point we wish to discuss hear, regarding the extent to 
which detailed balance is violated. For this purpose, we 
define the quantity B as 



exp[-B(x i+1 ,Xi;ai)] 



P(xj\x l+ i; ai)p ss (x 2+ i; aj) 
P(x i+ i \x i ;a l )p ss (xi;a i ) 



(34) 



Then using Eqs. (|3|), (p2[), and (|33|), we obtain an alter- 
native expression of the house-keeping heat Qhk: 



N-l 



(35) 



The fifth point we wish to discuss here is the relation 
between our present results and those previously pre- 
sented by one of the authors Note that if we can 
decompose (f> as 



4> = -[3[F* -X(x;f)-U(x;\)}, 



(36) 



the following equality holds: 



(37) 



i=l 



We point out that F* here is different from the free en- 
ergy F defined by Eq. (p3|) It is seen that Eq. ( |37| ) 
is a special case of Eq. (|ll[), since here the only con- 
trol parameter is A, and the assumption implicit in the 
decomposition of Eq. ([36]) is nessesary for its derivation. 

In conclusion, by defining the excess heat, we have de- 
rive the second law for SST, Eq. (19), in the case of a 
simple stochastic model. The corresponding thermody- 
namic function, the generalized entropy, is found to be 
the Shannon entropy. Also, it is found that for a slow 
process, the change in this entropy is identical to the 
excess heat divided by the temperature. 
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